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ABSTRACT . ' " \ 

» - Four comaercialiy available work evaluation systsms 

' are compared 'using a standardized 'oufline; dei,vel.opment, • organii;ation, 
• wotk evaluation process, administration, scoring and norms, 
observation of clients, reporting utility, training in the system, 
teclinica>l considerations, reviewer's summary and ctioments, .address, 
• post^ and references. There are-four sipctions; (1) a. brief paper 
listing factors to be" conside^red in selecting a coiamercial evaluation 
battery for suph tools as on-the- job* eyalaations, sheltered ' 
^mEiloyment, work samples, and psychological tests for'asessing 
clients* potential; (2) an explanation of the fourteen major points 
(criteria! In* the outline; (3) a tabl^ presenting brie^f comparison of 
the tons systems On the first ten points .(points 11-14 not ' ^ 
appropriate to summarize) ; and (4> more detailed description of each 
system including reviawer's comments, address, cost, and^references. " 
The four systems covered .are comprehensive Occupational Assessment 
and Training system (CQAfs) , Hester Evaluation System/ Micro-TOHER, ' 
and Vocational Information and Evaluation Work Samples (VIEWS). Seven- 
older systeas arfe compared in a separate document using the same 
'format (see Note). ' (J^) . ' . , * . V . 
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INTRODUCTION 

_i In December, 1971, Dr. Dennis Dunn published a "Comparisonof-the-JeVS^ 

Singer/Graf lex and TOWER Work Evaluation Systems." This paper, reprinted by 
the Materials Deve-lopment Center as Reprin^ Seriei No. 5, has been disseminated 
to thousands of individuals. Since 1971,. new cotRmercial vocational ev^iluation 
systems have been developed and older ones revised, making this original com- 
parison out-of^iate. In February t_1976, MDC published A Comparison of Seven 
Vocational Evaluation Systems .^ This publication compared the JEVS, McCarron- 
Dial. Singer, TAP, TOWER, Valpar, and WREST using a standardized outline based 
on the Reprint Series No. 5 and the MDC sound-sl ide presentations in the Ori- 
jentatioh to Work Evaluation Batteries Series. When this publ icatf on* proved 
to be very successful, the next logical step was to prepare' a new publication 
containing information on four systems that were developed after the original 
compaV'ison was. printed. Thus, this publication uses the same ,f orraat-ta-coro=^- 
pare the COATS, Hester, Micro-TOWEI^. and V'lEWS. - . ► " 

The purpose of this publication and its predecessor is to present a rea- 
sonably objective comparison of votatibnal evaluation systems. In preparing 
this comparison, manuals, technical reports, afrd related publications were, 
used to obtain information about each system. It is hoped that this -publica-^ 
tion and the original comparfsons publication will be used as a guide for po- 
t:ential purchasers so that they can. examine each system in li^ht of their own 
needs. Facilities considering the purchase of *any system should'not pnly talk 
with vocational evaluators in facil i ties- who are using a system, but should 
also see the system in action prior to making a final decision. 

* This. publication contains four Sections. The first is. an «edi ted reprint 
of an article on how to select a' commercial vocational evaluation system- . 
(Botterbusch and Sax, 1977); this article is based on the int»:oduc tion' to the 
ear.lier comparison publication. The second- is ^n explanation of the 14 major 
points" contained in- the outline. The third s^ection is a vtable which i?resents 
a very brief comparison of the four systems on the first A^Qn points iti the 
outline (Points 11 throu'gh .14 are not presented because ofvreduh'daney or not 
being appropriate to summarize). The fourth section contains a more detailed 
description of each voq^tional evaluation system, including rev iejwer's com-^ 
ment|j, address, cost and references. . ; V * 

Two final comments, are necessary. First, because most sjfstems are con- ^ 
stantly being revised, expanded, and updated, the potential user sihould contact 
the manufacturers for the most recent information. Second, fot those who de- 
sire additional information, (the Materials Development Center^liiasva sourtd-^ 
slide presentation on each ^f the vocational ev^aluation systems .described 
in this publication and in the previous comparisons publ ication..' • 'fThbse in- (J 
terested in the "sound-sl ide presentations should write MDC, for* a ibrochure 
descrijjing ,this series.) • ' ' ' i , , ^ 

^ Karl F. Botterbusch, Ph.D. 

' ^gust.'-,l977 

- . ' . 'i ' . • _ 

— V- 



NOTE ' ^ , 



There are two separate MDC publ icat.ions comparing vocational -evaluation 
systems. These are: • • ' ! ^ ' 

A Compari,son of Seven \/ocational Evaluation Systems * , $1.50 
A Cojnpari son of Four Vocational Evaluation Systems . * $1.00. 

If you order additional copies of one or both' of these publications, ^ 
please specify the exact title when ordering and note the difference in 
prices. ' . ... 
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, S(>t^QNSmRATI.QNS FOR THF SFt FCIIQN. OF. A , COMMERCIAL _ 

VJ VOCATIONAL EVALUATION SYSTEM ^ 

Over the yedrs many people have contacted the MDC for advice concerning 
the most appropriate vocational evaluation system to purchase for their fapiT- 
; |ty7~ This section was prepared in 'response to these requests and will outline 
' some of the factors to be considered prior to purchasing a conwercial voca- 
tional evaluation system. The evaluator has at his disposal many tools-for 
.assessing client potential .(Task Force No. 2, 1975). These tools fa |1 within 
one of the following four categories: • - 

. ' ' • ■ . ■ ^ 

■ 1. . On-the-Job EvaluaUpns - These. are situations^ i n which the client is 
assessed in one or more of a variety of real work situations inciua- 
ing: job site situations in industry, trial training evaluation in 
' a training program, and simulated job sta^tions within the facility. 

2. < Sheltered Ehiployment - This offers the evaluator "an 'opportunity for 

assessing the. client under working conditions that shoijld be similar 
to those found in competitive employment. 

3. Work Samples - T|iere are four types*^ of work saiftples according to 

* their degree of correspondence With actual jobs: actual job samples, - 

simulated job samples, ctuster trait* samples, and single trait sam- 
. pi es . . - - 



4. 



Psychological' Tests - These jnclude an almost endless variety of 
paper-and-pencil and apparatus techniques for meeisuring traits, ^ 
abilities, and related chaiKacteri sties of an individual. 



Faced with the ne|d to equip and administer a vdcational evaluation unit, ^ 
many untrained and ' inexperienced <vevdluators feeil that the purchase of a 
cQiimercial evaluation battery will solve thetr problems. The evaluator should 
. analyze a number^ of factors in deciding how to equip the evaluation unit and 
'then carefully investigation the tools listed in the above categories to 

determine the ones that will provide him with the b^t methods to adequately 

assess his clients.* . — " 

' The first, area of consideration i^ the rel-ationship between the comnunity 
and the vocational evaluation. unit. The evaluator must carefully invest|k|ate 
the range and type of job^. that are availableMn the local labor market. 
'Thus, a small rural facility or a facility in a one industry community will 
most likely have a narrower range of job evaluation stations than a facility 
in Sn urban area. Labor market information can be obtained through vocational 
surveys, local employment offices ancf agenci'es, and client placement records. 
'Once potential employment opportunities have been determined, intelligent - 
. decisions can l)e made ^n^ what type of evaluation tools can best assess these 
demands. * ' 



r' 



Because the evaluation outcomes may. not result in immediate placement, 
jt is also necessary to inves,t;igate the training oppor?:urVities available for 
clients and these should also be reflected- in the selection, of evaluation 
tools. A client's range of occupations widens and his chances for upward 
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'mobility are frequently increased as a result of training. The presence of 
an-area vocationa-i«4;eehaical school, private Vade and business school s\ on- 
the- job training programs, apprenticeship programs^ -and even higher education w 
should be reflected ^in the evaluation unit. Vocational evaluation techniV^s . 
covering a, wide variety of occupational areas and assessing the full range / 
of client aptitudes afld interests are needed if the facility is in. an area 
where. many employment and training opportunities are available. | 

'The second cons ideraTO?rts^he client population. Some evaluation 
units must be capable of serving clients with all types of-mental, >^ physical , 
psychological, and cultural disabilities. Other facil itiei restrict them- 
selves to serving either a singlfe disability or a small* number of dis- 
abilities. A facility Ti^aling with many types of handicaps would genere^lly ^ 

nee d to have techniques CQve<lTng the entire range of occupational areas and 

Ski I iTeveTs'witHin these areas. A facility providing services to" a single " 
disability group could safely limit its evaluation areas. Fo,r example> a 
facility serving only mentally retarded cliftpts could realistically avoid 
evaluation for occupations that require a gfeat deal of fatmallzed training 
or higher education. Some systems claim 'to have been designed specifically 
for a particular level of Client fun^tjpning. When selecting evaluation 
tools, keep in mind the type of clients^^eicved since It would be a waste of 
time to assess a client for a job he cotfld not fill because of his handicap. 
At the present* time, all commercial vocational evaluation systems are de- 
signed for persons who can see and hear a n(^ contain no special* instructions' 
or modifications for the blind or deaf. The evaluator shoald be aware that 
he frequently will have to make modifications in commercial work samples so 
that they meet the special needs of his clients (Botterbusch, 1976(b); Dick- 
son, 1976). In summary, if an evaluator is considering a commercial evalu- 
ation battery, he should check the battery against the needs of the client 
population served and then decide: (l)'whether the system is design ed F or 
the target disability group(s), or (2) whether other evaluation techniques 
woultl be more appropriate. . - ' 

The third area to be consider^ is the purpose of evaluation. Although 
all vocational evaluation techniques should provide career information, a 
particular technique may^ either emphasize occupational information by pro- 
viding a hanc|s-on experience or it m^ emphasize the assessment of present 
skills and aptitudes without relating it ta career information. Some systems 
attempt to provide a thorough evaluation of the. client's aptitudes and work . 
behaviors; others provide occupational ififorraation and experience, often at * 
the expense of a thorough ability assessment!^ The evaluator should check 
the final report format to determine exactly )n(jat information i^t contains; 
this goes a long way in determining the purpose of a particular system. The 
evaluator must firs.t decide what needs to be included in these areas and then 
attempt to find or develop the evaluation tools that best fit the client's 
needs. A system should never be purchased to "fit in somewhere." 

. . */' • ■ * 

The fourth 9rea of concern is 'perhaps the most basic— why even purchase 
a commercial evaluation system at all? All of the systems are relatively 
expensive; s(^e are yery expensive. None will probablj^ meet the •individual, 
needs of a fatility in terms of community jobs and training, client popu- 
lations, and purpose of evaluation. A facility could develop its own eval- 
uation unit based on job or work samples taken from local industry.'' This 
would make evaluation very 'realistic for the client, staff, and even for a 
potential employer. Jdditioncll work samples could be developed from 'existing 
subcontracts in the workshop. This method not only will, assess the areas in 
which the client' has his maximtim functions and Interests, but also the areas 



' of the shop that wou\d best fif the cli4ht. In addition, the client would L 
receive training on the work performed in the workshop. Then, when the cli^ , 
ent is transferred from the evaluation unit, he or she will be familiar With 
/the subcontract,, which should alleviate-tfie need for the, supervisor to train 
the client from "sera tfch." . . ' , / 

The development of a work sample is ejipensive in terms of staff time.*. 
In most fab'ilities, staff are hired to provide direct client service, and to 
have a staff person doing developmental work reduces the time available for 
working with clients. #ew evaluation units can afford the luxury of develop- ', 
rkental time for staff persons. Besides the time element, development of ' 
evaluation tools demands a working knowledge of the skills required to per- ' 
form' jobs and to. analyze tasks, of form and report design, of behavior . 
^analysis, of statistics for norms, and of indu strial engineering techniques'. 
Al though these skills are becoming tfipre" and more widespread among ^valuators; - 
. there are stilVmany facilities that lack persons with these competencies. 
The lack of developmental time coupled "with the inexperience of some eyal- • 
flfi tors is partly responsible for the increased use of commercial eva'tuatioh 
•systems. ' The purchase of these systems' as a' matter of convenience does not 
necessarily imply that the systems are not useful to the evaluator. ^ 

. The first decision is whether the evaluation unit is meeting client 
needs tin terms of accurate assessment for available jobs and/or training. If 
needs are hot being met, the s.econd decision becomes a qu^tion of what areas 
of job asses^sment are needed 'for the evaluation unit. ^ After these need§ are 
known, a thorough review of the different evaluation techniques, commercial 
vocational evaluation batteries (or parts of these batteries), and other 
available resources should be made to determine hovy to best meet these needs. 
However, it is a common practi(^$ for many persons .to want to buy a system 
that -will give all, the.^nSwers. Such a syst'em simply does not exist.' There 
is also the possibility of carefully selecting individual work sampTes from 
several systfifis gnd combining these into a unified system specific to the 
needs of the facility. To have appropriate evaluation stations, there has* 
* to be a great deal of analysis of what is to be accompli sfjed during evalua- 
tion, the available jobs and training opportunities, the types of clients 
with whom you are working, and the best way to acedmplish the goals of your 
'facility. This analysis is absolutely necessary before a workable system ' 
.can be developed. - '. . ' ' 

£ 

The' preceding- points should only be used as general guidelines because 
each facilltiy Is unique. A critical, factor, in purchasing a system should be 
based on the knowledge of what is needed Snd not on the cbst or attractive- 
ness of the hardware. Usually, no one system will meet all the needs of a 
facility and the purchased system should be integrated with facility con- 
stt^ucted devices, other eyaluation systems, on-tha-job evaluation, and psy^ 
^ chological tests. MDC suggests that a facility obtain as much accurate in-* 
formation as possible about'a system prior to purchasa. Some sources of in- 
formation are: ' '-r 



' *The MDC Work Sampll Manual Clearinghouse is attempting to reduce the 
developmental time by making completed work saroole manuals available to 
evaluators. • 
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1. The information contained in this present' publication and in 
A Coniparison of S>ven Vocational Evaluation Systems 

.;(Bottfert)uschi 1976(a)'. ~ — — 

2. MDC*s\sound-sTide presentations on* most evaluation systems. : 
A brochure listing these programs is avaifable from MDC. 

3.. Talk wi^th evaluators in other facilities w^o are using the 
' , system being considered and see what they thinij: of it. 

4., If possible, try oiit the system yourself with clients in 
another facility, ; * ^ 

5. Write the systeip's manufacturer and obtain current infor- 



In nnnrliisiony MDnWarmot reco mmend what commer cial sys temfs) 'will hp best for- 



mation.. \ 

_ MDCl carmot recommend wha t commer ci al 
a facility because ^electing the appropriate system is (or should 'be) based 
on an accurate, realistic assessment 'of the. unique needs of each facility. 

y ■ ■ ■ ■ ■■ 
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VOCATIONAL EVALUATION SYSTEM OUTLINE 
Development \ 



a. Sponsor - The name of the organization who ortginally funded or 
financed the development of the vocational* evaluation system. ^ 

b. Target Grou^ - What specific populations, such as disadvantaged, 
mentally retarded, or physically handicapped, was the system de- 
signed ta serve? • • . . 

c. Basis of the^ystem - What- theoretical or org^izational princi- 
ple, such as the Dictionary- of Occupational Titles , wa-s used as 

— — a basi^ for d o v eToi^meflt? — , ^ 



Organization ' . * . * 

a. Nanjp and Number of Wor1c Samples - What are the, names of the woj^k 
san|)T§s and how many work samples does the system contain? 

b. 'Grouping of -Work Samples - Wha't is ^he arrangement of the indi-; 

vidual woY^k samples within the system? Are several work samples 
grouped in- a hierarchy or^is each work sample independent? 

c. Packaging of Work Samples - What'is the physical retup of the 
work ^samjftes in the battery? 

d. , Manual - What is the physical description of the manual and 

does it provide all the details that the evalijator heeds to 
know in order to use the system? 

Work Evaluation Process ' • ^ . . 

a. Preliminary Scjpeening - What information is needed or what deci- 
sions must be made before a client can be administered the syst^? 

b. Sequence of Vork Samp^le Administration r In what order are the . 
work* sam'ples administered? . V 

c. Client Involvement - To what extent is the client informed "of 
his/her progress during the course of administration? What 
type of formal feedback is given to the client after the entire 
battery has been administered? What type of contact does the ^ - 
cltent have wi^h the evaluator? • » 

►d/ Evaluation Setting.- Does the -gftneral environment att^pt to 
simulate industry, produce a classroom atmosphere, or resembTfe 
a formal testing situation? 

e. Time to Complete the Entire System - How long does it take the 
average client to complete all. vthe work samples in the system? 

Administration v. .. ' 

p. Procedures - Is the purpose ^of each work sample, materia^l^^;:;^ 
needed, layout, and general instructions clearly given *so ijiaf . 
there is little chance of^ misinterpretation? * - ~ 

b. Method of Instruction Giving - *How does the client receive his/ ^ 
her instructions fQi;r.the wowc, sanfples in the system-, ^fi?r ex- ^ 
ample: oral, *demonsJ^atill)n,'*tau^ or audio-vis^jal? 



c. RepeatTnO'oi^k Samples -n?fiat~prdv:i sterns-are made for -the 
readministratlon of SQme Work samples' and what 1s the pur|3osie 
of readminlstration? \ 

d. 'Providing Assistance to the Client - What procedure^ are there * 

for giving* extra or additional instructions, demonstrations, or 
feedback after the |i§Mod of initial' instructions? • 

Scoring and Norms . ^ 

a. Timing - What are the procedures for timing the client? 

b. Timing Inj:erval - When does the 6valuaitor start timing the 
client and when dOQg/he stop? - 

N^. Time Norms - What is the procedure for reporting the time 
score for each work sample? 

d. .ErrorsScoring -JJhat procedures, such as a random check of some 
"parts, -general rating of overall quality, or a comparison to 

standards, are used for determining errors? 

e. Scoring Aids - What use is made >f overlays, templates, models, 
etc., to make> scoring more ^acc urate and easier for the evaltator?^ 

f. Quality Norms - What procedures ar^usdd for reporting the 
number of errors, quality rating, etc., for each work sample? 

g. Emphasis In Scoring - Does the system •emphasize time or errors 
in the scoring process? * 

Observation of CI ients 

a. Work Performance - Are work performance factors (e.g., fine 
finger dexterity, color 'percepti-lon) .listed for the system and- 
are specific work performance factors given/for each work 

^ sampl e? ^ . • ' 

b. Work Behaviors - Are work behaviors (e.g., ablHty to follovy . . 
Instructions, communication with supervisors) (|efined for the - 
system and are specific^ork behaviors to be observed for each 
work saWle? , • • 

c. Rating System - What procedures does th'e* system have for the- 
recording, describing, and rating of observed work performance 
and work behaviors? . ^ $0 

d. Frequency of Observation r How often and to what extent Is the 
. evaluator to observe and record client behavior? . 

Reporting^ - 

ao Fo/ms •/ What forms are incl ud.ed- with the system? 

b.V.Fi'nal ^pprt* Format - What information is 'included in the final 

report and what type of format (e.g. ^rating scales, free narra- 
. * tion) .is used to present the informa'ioh? 

Utility > 

' " ■ — ^ ' • . ,1^ . ' * 

a. Vocational Exploration - Does the system provide experiences , 
that the clien.t can readily relate to real jobs? 



b. Vocational 'Reconinendations - Are training and job reconmenda- 
-tions. specific* or general? How~are-tlTCy-relcrted--t6 the DOT or- 
other. job' classification systems? 

c. Counselor Utilization.- Can the sy?tem provide the counselor of 
referring agency with useful information and to what extent is 
the counselor involved in the process? v 

9. Training in the System 

« ^ ■ . » 

a. Training Required - Is formal training, required before the sys- 
; tem is sold? . ' * ' 

b. Training Available - Is formal training available? ^ • 

• C-. — 5tirat ion-— 4iovMauch-i;^Tme-4s-4^^^ for t rain i n g? ^— ^ 



d. Follow-up -*Is technical kssis^ance available after purchase 
and training? " 

Technical Considerations ^ • * ' ■ 



a. Norm Base - What norms are available and are the norm groups 
clearly defined? 'Are industrial norms (i.e. , employed worker) - 
available?. , - - 

b. Reliabilit^y - What empirical evidenced there to demonstrate 
that the system' gives reliable or consistent results?' 

c. Validity - What empirical evidence is available to indicate 
' that the system really does what it claims, such as make-more 

realistic choices, job and training success, etc.? 

. 11. Reviewer's Sunmary and Comments - This contains what the reviewer 
considers to be the major advantages and disadvantages of the 
system, 

12. Address - The^ address of the manufacturer is given* for those 
Wishing ^obtain additional information. 

13. Cost - Th4;present cost of the systan and what materials and serv- 
ices ar& iiicluded in the price. 



eferences - All -generally available references are given; those 
not ayailable from the MDC Loan'Service are indicated by an 
rasterisk(*). - . 
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as- 


Outline 

• ' . «- ^ 


COATS 


Hester . ^ 


1. bevel opment 

a . Sponsor 

b. Target Group 

c. Basis of System 

: -m ■ 


Prep, Inc.. 

manpower, secondary educa- 
tion and rehabilitation 

• 

research studies of need 


Goodwill Industries of . 
Xhica^o 

rehabilitation clients 

Dictionary of Occupational 
Titles 




V 






■ — ^ - 

2. Organization 

.a. Number of Work " 
Samples 

b. Grouping, of Work 
Samples 

c. Packaging of Work 
■ _ Samples 

d. Manual 


4 components -' job matching, 
empl oyabfl i ty atti tudes , 
viork samp'le~s, and living 
sk'ills 

10 work samples; each is 
independent^ 

each^separafely packaged in 
pOrta'ble container 

separate manual for each 
component, contains all < 
details 


28, psy ch'o logical tests 

9 • ■ 

grouped into 7 factors ^ 

same individually packaged 

OTtsej;., contains most 
system details . ? * 


3. Work Evaluation 
Procesfe 

a. Preliminary 
Screening 

b. Sequence of 
Adji^inistration 

• c. Client Involvement , 

d. Evaluation 
Setting 

,6. Time tO' Compl ete 
Entire System 


• 

not required 

■J 

components and work safFples 
may be given in any order 

extensive cl lent involvement 

cla^room atmosf)here - 

estimate* 28 to 60 hours 

♦ ♦ 


• 

not required 

• 

no specific order specified 

little client involySment 
formal testing atmosphere 

estimate 5 hours 

* . * • 



Mlcro-TOWER 



• VIEWS 



ICD Rehabilitation and 
Researcii Center . ' 

jrehabllltatlpn clients- 
.7 aptitudes 



Philadelphia JEVS 
m^tal ly . retarded 



Ojctiopary of Occupation.al 
Titles: * • - 



. \. ,A. 
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, .5. ,qro»ipf^ of genera 1 



aptitudes 

eachjndlvldually . 
packaged 

several loanuals; each 
printed, contains all 
System details ^ 
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.4 areas of wor|L- ..^u ._. 

.-^ ^ .. . ^. 
most Individually 
packaged 

offset, contains all system 
details . 



not required 

at the discretion t)f the 
eval uator . 

extensive client' Involvement 

coRblnatfon of formal test- 
ing iind counseling 

15 to 20 hours 



not required 



progressive from lelast to 
most complex 

extensive client involvement 

realistic work setting 
stressed 

estimate from 20 to 35 hours 



4 



'7 * 



Outline 



COATS 



Hester 



4. Adrainls'tration 

^:;.a. Procedures 

. b, Methods of Instruc- 
* t4bn Giving^ : , . 

. c. Repeating Wbrk 

Sainpl es 

• ■ 

d. Providing As- 
' sistance to Client 



specified in detail 
audio-visual 

.not specified , " 

• little assistance after 
timing b^ins 



not speti-fied in detail 
oral and d^nstration 



if necessary-, after 
2 weeks ' ; 

no assistance after 
timing begins 



J 



5^ Scor.ing and Norms 

a. Timing. 

b. Tirtiing Interval 

c. Time ^^o^ns 



evaluator times client or 
client- times self 

not specified \, 



computer generated scores 



evaluator times client 
varies with type of test 

4 

no separate time -norms 

.g^V^n ' - . . -^ :.: — 



d. Error Scoring 



e. 
f. 



Scoring Aids 
Quality Norms 

Emphasis 'in 
Scoring ♦ 



compared tq standards 
not used ♦ 

computer generated skill 
rating 

quality 



no separate' error .norms 
given 

not used 



time to completion or 
nymber of^ responses 



6. . Observation of Clients 
a. Woirk' Performance 

h. . Work Behaviors 
c. Rating System 

• d. Frequency of 
Observation. 



no factors recorded 



some factors* defined 

none; the number of 
.behaviors is recorded 

not specified , 



Because the Hest^ uses 
psychological and psycho- 
physical tests, no be- 
havioral observations' 
are made. 
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MIcro-TOWER 



VIEWS 



specified .in. detail 

audio-cassette, evaluatpr 
demonstrations 

not specified . 

no assistance after 
timing begins 



s pec 1 f i ed i n d e ta i 1 



oral and model i ng, .f 1 exK 
biltity to use. a variety of 
techniques stressed 

repea'ted if ♦absolrffely 
necessary / ^ 

1 ittle' assistance after 
timing begins 



cassette tape , _ 

specified f^ each work 
sample 



number completed; pieces 
correct 

some use ^ 
rated on 5 point scale ' 



emphasis on quality 



evaluator times clieiit 

after taisk i-s learned to 
c6mpletion 

j^iited on*jl4Joirit.^ca3 
also MObAPTS , 

compared to standards 
some use • 

rated on 3 point scale' 



time and quality given 
equal weight 



no' specific work factor 
specified 

5 woir*k behaviors listed 
none • 

frequent observations are 
expected 



10 factors-^ specified 

clearly defined 
2 or 3 point scale 

extensive observations 





Outi i ne 

* 

< 


* COATS- 

* 


■ ■ " } . ' ' 

r" Hester' / 

* ■ 

T _ ' " ; ; ^ J - 


7. Reporting ' 

a. -Fontis ' ' . " - 

.■ . ■ : .. >..-. ■ ■ 

b. Final Report 
Format ' 

o , *- 

* 


■* • * ■ . 
. * * * * 

standardized forms for all 
phases . " 

separate computer printout • . 
for each component ' 

' • •. ' ' • 

■ ■ > ■ •• 

* 

• ■ ■ « 


' l' '• ' 

■ ' . . • •. •• ' . ' : 
standardized Vortns for all 

phases ' , - 

computer geherated r^ort 
1 1 sts -Worker Trait^roups 

and specific jobs - • i 

••.>■■■•■;■•.■■,;■-,-', 

... ' . * 

, ^ ■ . . ' ■ ■ 


8. Utility 

a. Vocational , ' 
Exploration, 

b. . Vocational , 

Recomriendations 

c. Counselor 


extensive occupational 
information given to client" 

specific jobs and groups 
^of jobs ' ^ ' ^ 

^l«>sign^ for clieniL «;plf- _ 


• 

little use to client . 
completely related to^ DOT 

» • * 

1 designed fon counGolor use V 




"Utilization 

i- 

«t * 


interpretation 

• ■ • ■ - 


■ • .. - i 

- • 

> . . ■ * ■ - 


9. Training in the , 
System ; 

a. Training Required 

b. Training . > 
Available 

C. . Duration 

d. Follow-up 

Ct " ■ ' ■ 


, . ■ — ■ — 

no 

*• 

yes 

3 to 5 days 

yes . . ' ' 


yes 
yes 

3 days 5 / 
yes ■ 

■ • 


V ■ . • 

10. Technical 

Considerations 

^. a. Norm Base 

b. Reliability , ' 

c. 'Validity 

• .{ ■ • ,' ^ 


student norms on work 
samples 

adequate data in manuals- 

adequate data in manuals 

■i^ ■ ■ ■ 

. 4 ' . 


f 

• ■ 

little- information^ 
available 

test-retest reliabilities 
high . * 

manual contains little 
data 



' staodardized f orms f pr all 
phases v - 

* three- separate forms used 
, to jf^eport different resiults 



Micro-TOWER 



standardized f6rms for all 
phases 

stahdg^rdized. format con- - 
^taqnlng. behavior data. and 
reconmended WQff*ker Jrait' , 
Groups 



some use $0 cl ient 



related to DOT 



designed for referral . 



agency use or nrst step 
in longer evaluation 



no 

yes 



2 to 3 itays 
not specified 



several norm groups 

adequatis data in manual - 
high reliabilities 

construct validity is 
more than adequat:e . 



VIEWS 



little u^e to client ^ 

comj^lr^tely related to DOT 

' • ■ •■ . 

or i entated t^wav^ rnun- 



selor 



a 




yes 
yes 

s 

1 week 
yes . 



mentally retarded adults; 
MODAPTS 

no data available 



no data available 
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Comprehensive Occupational Ass^ssment'^and Training System 



X (COATS) . ^ 



Bevel opment • $ > ■ ^ " 

a. .Sponsor - Prep, Jnc. , 

b. Target^Group - Originally designed for us.e fii manpower . programs ' 
and secondary education guidance programs, the .COATS has .been 
slightly modified to serve* a. rehabilitation population, ' 

«-c,^ Basis of the System T Various research studies by Prep, Inc. 
I ' and others Established the need f<or>^^nd th^ content of each of , 
^ "thfe four components listed below. • ' • 

' ' ■ ' «' ... 

Organization ' • ' ' . 

/V >. *■ . ' ■ • ■ , » . 

a. Name and Nt^ber of Work Samples - The COATS system consists of . 
. four components which aire intended to give the evalua tor a complete 
picture of the client. (Each component may be used Independently.) 
Each component contains three different* program levels: (1) assess- 
' ment and arfalysis, (2) prescription and instruction, and (3) eval- 
uation arid placement, the four Components are as follows.: 

^) Job ^fatch^ng System - This component matches ^he perston with 
job and tra ining oppQrtuni. ties. The system is based on the 
aegree to which workers approach or avoid 16 speffijic skill 
categories. The client uses the prdgram to identify his own 
preferences, experiences, and capabilities. 

- (a) Assessment - Fifteen audio-visual cartridges present 
. * . photographs arKi drawings fran each of the skill categories. 
.Five cartridges, deal with worker preferences, five with 
experience and five with capabilities. 

(bj Prescription - The client uses the infofC^i on gained . 
during the as,sessment phase to plan and perform activities 
designed *to help him learn about himself and job require- 
ments. . These. activities are contained in a Student Hand- 
book. . . • , . 




J. 



Evaluation - The client carries put the previously planned^ 
exercises and plots his progress. 

'(2) Bnployablllty Attitudes System - In this component the client 
determines what his attitud'es and behaviors are and compares 
thlem with the attitudes that employers see as being important 
for the hiring, promoting, or firing of an employee. Thirteen 

. job seeking attitudes and 23 job keeping and job advancing • 
categories are used". 

(a) Assessment - Six aOdio-visual cartridges conta'fning what 
' the developer calls 25 "veal life" adventures are used; 

(b) Prescription .- Exercises in. the Student Handbool^ help the 
client inter.pret the results and compare his results with, 
employer data. ' 

(c) Evaluation -" Clients keep track of the^r attitude develop-^ 
ment by*chartiTig their activities on Learjfiing Activity Maps. 

, Criteria for successful completion of the activities are 

give,. . . .- . ■, 



•> (3) Work Samples $y'stm - Presently the COATS cont?n*ns ten work 
^ samples that were developed on the basis of content analysis' • 
^ of tasks common to job families: Praftihgi Clerical -Off ice; - 

Metal Construction; Sales; Wood Cor>struction;*Food Preparation; ^ 
. Medical Services; Travel Services;'Barbering-Cosn\jetol(wy; arid 
Small Engine. * , . , , 1_ ^, • . 

^ (a) Assessment Instructions are contained on audio-visual 
cartridges. Each work ^ampte contains occupational in- 
» • . - , formation which is used ti^ elicit the degree of cTi.ent 
- • interest in the work sample. The instriictions &re giv^n 

in a step-by-step mafnner and the cartridge stops when a 
' vta^k is to i^e performed. ' ° " V " 

(b) Prescription -After computer scoring, the client uses a 

. " Student Handbook' to interpret his results. ' - 

■' • " . . . ^ • 

'(c) Evaluation - The cl ient further, investigates jobs related 
to preferred work samples and performs additional -job 
related tasks that were not included in the j^ork sample. 

(4) living Skills System - The component- defetls with what skills 

are needed to be functionally literate in contemporary society: J 
The program classifies literacy into skills {reading, writing, 
computatiofl, problem solving, and speaking-listening) and knowl- 

■ edge areaS: (consumer economics, occupational knowledge, com- ■ 

^munity resdurces, health, and gOvefrSienx- law).- 

- \(a) Assessment - Six cartridges containing 18 "adventures" 

'. ^ • are used to evaluate literacy skills and knowledge areas. ^ 

^b) Prescription * The skills and knowledge areas are reported 
. to- the client. in a 5 5 matrix. Weak are^ are identified 
• us ihg a Student Handbook. . ■%.«: . 

' ■ ^ (c) Evaluation - iBdividuiali zed objectives are^%stabli4hed 
and the client works toward raising his literacy levels 
where necessary. ' ' - 

b. Grouping of Work Samples - There are four components in the COATS 
• system. These are described above. Each work sample is independent. 

.. c. Packaging of Work Samples - Each or the ten' work samples is separately 
packaged in a portable container no larger than 16 x 24 x 20. The 
work samples can be set up on a table top or in a 48 inch wide car- 
rel. The other three components are each packaged separately. 

d. Manual - The COATS uses a separate loose-leaf manual for each, com- 
ponent. These manuals contain all administration details, interpre- 
tation of results, hints for working with clients^ on eachjof the 
-'^ .three levels, as. well as ,a summary of the research studies and the . 

development methodology used for each component. A separate manual 
is also used for each work s^ple. 

3. Work Evaluation Process - ' 

a. ^^^elim'in^ry Screening - N6 preliminary screening is required. 



« ■ * 



b.. Sequence of Work Sample Administration - The four components may 
* be given in any orfler. The ten work samples need not all be adinin- 

^ isterjed or administered >n any particular crrder. Because each comr • 
, ponent is .moVe-or-less independent, comp'onents -may be purchased and 
used independently of each. other. . / , ' ; 



c. Client Involvement - Therp is extensive client involvement follow- 
ing the assessment ^hase of each component. Thexlient uses the 
appropriate Student Handbook to int^pret his results, then pilans 
and follows activities designed ^o change his attitudes and/or be- 
"havior. The evaluatoV monitors client progress, helps when neces.- 

^ sary,. and cobrdinates,.th«;.activities> of several cl*ients. 

d. . Evaluatiori.Setttng - Although' the ;manuals^dojiot specify, a partic- 

ular setting, the use of ai)diT)-visua]\rn5tterials. answer sheets, hand- 
books, as well as the ehiphasis on activities gives the COATS a class- 
room atmosphere. - « 

e. Time to Complete the Entire System*- If all ten work sampl^ are 
\ given, the worl^ samples take from 18 to 40 hdurs to administer^ 

The other three components take an 'estimated iO to 20 hours. 
. These estimates are for the assessment level only. All components 
except work- samples, can be administered to small groups. 

- • 

4. Administration • •* ' ' . . * 

, -a. Procedures - The materials rflqiiirpd and the layout a re^clearlv 
described. 

* ■ . 

b. Method .of Instruction Giving - During the assessmef\|^ phase, all 
instructions are presented on a cartridge containing an ^ight- track 
audio tape synchronized with a 16mm filmstrip. The client re- 
sponds by using separate answer sheets for each component arid for 
each work sample." Student handbooks, learning cbntracts, aind activ- 
ity maps are used during the prescription and evaluation ptiases. 
The reviewer estimates tha't an eighth grade r&ading level is re- 

^'quir^ for ajlequate use of the printed-ipatferjals. 

c. Repeating^ Work' Samples - No information. is contained in ttie manuals 
^ concerning the readministration of work sarilples or the bther three 

components. ^ ^ . , • . 

' . d^ Providing Assistance- to the Client - The evaluator is to make 
certain that the e^l i en t understands all instructions prior to 
beginning a task. Additional instructions can Be given once 
: the task has begun if the client is having trouble understanding 

..them. . . „ • . 



5. Scoring and'^Norms 

a. timing - The .only timed components are t))e work samples. . Here, 
either Ihe eValuator times the client or the client times him- 
' self. ^ 



* , b. Timing Interval ^ This is not specified in the work sample manuals,, 
:' but includes all the time the client is under the' direction of the 
audio-visual program. ^ 

V c. -'T*fme Norms - The total time to completion is reported on com- 

puter generated* Work Sample System Student Record Form. . . 
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d'. Error Scoring - After cdmj®^^*, all worK sample results are checked 
against carefully defined ^^^i^jl criteria. ^Th^ 
task within the wo.rk sampl ea^^^dged separately and rated on a 
■ four pointj'eitn rig scale. * ." ■ • 

e. ' $cor1ng A^ds - No ^scoring aids ssre used. . ^ • 

f. Quality Nbrm§/- The quality of each work sample :,is presented in 
th^^orm of .a skill rating and data on the percentage of tasks' 
successfully completed on the computer printout. 

g. Emphasis in Scorirtg-" - Time smd^ual i ty scores, are given for each work 
sample, .with* the emphasis on ^ual ity.' * 

Observation. of Clients . . ' ^ ^ " . ' 

a. Work Performance ~ No work performance factors are recorded in the 
evaluator'j.. Behavior Observation Fbrm during work sample adminis^ 
tration. * ' ^ t 

b. Work Behaviors - During the administration of each work sampie, the 
evaluator observes the cliAt on: efficiency, relationship to 
authority, behavior in work setting, peer relationships, and self - 
appearance. ' . 

c. Raiing System - No rating system is used; the evalUator uses a 
computer- SCO r fed fornTto record the numbeif of types of specific 
behaviors. 



d. Frequency of Observation - The manual does no.t give any specific 
. schedule for behavioral obser\?ations; it merely states that the 
client is to be observed on a* scheduled Basis. 

Reporting ^ 

a. Forms - The COATS contains computer- scored answer sheets for the 
Job Matching, Employability Attitudes, and Living Skills Systems. 
Each work sample uses- a separate form which contains client seTf- 
ratings of interest, quality, am'd speed. During. work sample admin- 
istration,, the Behavior Observation Form 'is used by the evaluator to 
record behaviors. At present, turnaround time is about'one week 
for computer scoring. 

b, Final Report Fonn^tt - Each component of the COATS system produces 
a comt)uter-generated final, report of the assessment pliase. The 
client uses a sep^^rate Student Handboolc, for each component to ' 
systematica'lly interpret these results^and then to plan and carry 
out prescribed activities. For clients who lack the ability or 
time to use the Student Handbook, the evaluator transfers the in- 
formattoYi from the prilfitouts onto an Interpretation Profile for. 
each component. These results are c(j{jibined into a single narrative 

. evaluation report. J' 

Utility * , 

a. Vocational Exploration r The Job Ma-tching, Employability Attitudes, 
and- .the Work Sample Systems provide the client with a wealth- of 
occupationStl , information. 

.b. "Vocational Recommendations - The COATS provides vocational recom- 
mendations for both individual jobs and groups of related job^s. 



c. 'Counselor Utilization r "At present the COATS is basically designed 
for client Xor student) self-^jjterpretation followed by. activities 
designed to chan|pe4;cl ient befiaVior., The evalua tor must be able to 
provide this counselor with a. useable report uSLing the wealth of data 



generated by the COATS, 

Training in the System . 

a. Training Required - No 

b. Training Available - Yey ^ 

c. Duration * Three to five days 
"d. Follow-up - Yes . 

.Technical ConsideratiOfts 



/ 



a-. 



b. 



c. 



Norm Base - Adequate norming procedures were used for all com- 
ponents 'except the Work Sample System. Only student time norms 
; are available fdr the work samples.. Ito client, employed worker, 
or industrial norms are available for the work samples. 

Reliability - Sunmaries of the research available in the four in- 
structor's manuals and in a separate research. publication indicate 
that the rel iabil ity of the components is adequate. 

Validity - Th.e,val idity of the COATS was established by sever^al . 
-d^fffer en t met h o ds a nd v a4"i44ty-da%a--a re availa b le in U rn four " — 
instructor's manuals. ' , . 



Reviewer's Summary and Comments 

The COATS is the most comprehensive evaluation system presently 
available for use in educational and rehabilitation settings. The 
system is logically consistent, well designed, and based on a wi^ja 
range of research studies. Two unique asp^ts are: (1)* the emphasis 
upon the client using the results of the assessment phase to plan 
and, hopefully. Change his own behavior and (2) the fact that each 
component can be used independently. This. means that a facility could 
use. for example, the Work Samples and Job Matching Systems in an 
evaluation unit, the Emplqyability Attitudes-System in a adjust- 
ment program^, and the Living Skills System in a literacy training p 
gram. The COATS was denned for school populations and this resuT 
in several potential af^oblems for -rehabilitation facilities: (1)' t^^ 
client must be able,p read at about the eighth grade level to use > 
the Student Handbook teffectively; (2) the lise of audio- visual format" 
and sepa^ate answer sheets may present $ome problems for persons' with 
hearing, visual <and/((r learning handicaps; and (3) the turnaround time 




of one week is a prob 




three week period of^avaluatio 



'Address 



Prep, Inc. 

1575 Parkway Avenue 

Trenton, New Jersey 08628 



em for facilities that typically have a twg to 





13. Cost /■ : ' ■ V' 

The eomplete cost for «ach compon^rtij^arid t'Ke iVScessary audio-viSuaT* 
equi43ment is as follows: (training 1^|gt included in cost) 

Job Matching System .$1,880.00 
Employability Attitudes System "^""^V 11,242.50 

Work Samples System (10 work samples) ., .^^w7,. 321.00 
Living Skills System ^ - y$l,jCi52.50 

J— Prep CouHter AudiorVi^ual, Projector PP^lOO 

(for' individual use) 

? Prep Tutor Audio-Visual Projector PP=40.1 
(for small group use) 

14. Refe);ence . . ♦ . 




Pisauro, M.«L., Comprehensive Occupational. As#s^nieh±9^tid Training 
System. In A: SaX .(Ed.) Innovations in VPcStionaV Evaluation 
Work Adjustment. Vocational Eval uation and Work Adjlistment 
Bulletin , 1976, 9(3), 3M5.. ' ■ ■■ ' . : • ^ 

— 



and 



Hester Evaluation System 
* (Hester) 



1. Development , • • . V 

. . a. .Sponsor - Goodwill Industries of Chyago ^ . 

. \' ■ ' . ■ ■ ■ V • ■ 

'b. -Target Group - Although designed for physically and mentally handi- , 
capped rehaDilitation populations (except persons who are.visually 
disabled), the Hester >can be use<i with almost atny educational and 
ability group, including, "normal" high school students and adults. 

c. Basis of the System ^ The Hester is based almost exclusively on 
the Dictionary of Occupational Titles (DOT)s especially the Data- 
People- Things hierarchy. Worker Trait Groups,, physical limitations, 
working conditions, general vocational preparation* (GEO), ^nd specific 
vocational preparatio/i (SVP). The Hester is not a work sai^jle, but 
a battery of psychological tests designed to relate client scores to 
the DOT. - . 

2. Organization • 

^ — au — Name and Number o f ■Work-.-Sampl es - Twenty^eigh t. i^e. factor .perform-^- 
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ance and paper and pencil scores (i.e., tests) are grouped into 
seven categories on the computer printout for ease of reading. 
These scores ass'ess the client's abilities on the Data and Things 
hierarchies.' (The system rec|.u ires the evaluator to detennine 
People levels based on interviews, case histories and evaluation 
results using various techniques. The system contains detailed 
instructions on» how to rate each level of the People hierarchy.) 
The 28 scores are" as follows: 

(1) Unilateral Motor Ability - Finger Dexterity (Pur die Peg board). 
Wrist-Finger Speed (Tapping Board) and Arm-Hand Steadiness 
(Lafayette Motor Steadiness Kit). i 

(2) Bil-ateral Motor Ability - Manual Dexterity (Minnesota Rate of 

• Manipulation), Two-Arm Coordination (Two-Arm Tracing Apparatus), 
Two-Hand Coordination (Etch-A-S ketch with Maze Overlay)., Hand- ' 
Tool Dexterity (Hand-Tool Dexterity Test), Multiple Limb Co- 
ordination (foot operated stapler)* and Machine Feeding (fold- 
ing machine). 

(3) Perceptual - Perceptual Accuracy (projector with slides)* Per^ 
ceptual .Speed (Tachistoscope)-5 and Spatial Perception (Revised 
Minnesota Paper Form Board Test). 

(4) Perceptual '- Motor Coordination-Aiming (Lafayette Motor Steadi- 
ness Kit), Reaction Time (Multi-Stimulus Reaction Timer), Fine 
Perceptual Motor Coordination fPolar Pursuit Tracker), and 
Visual Motor Reversal (rtirror Tracing Apparatus), 

(5) Intelligence - Abstract Reasoning (Raven Progressive Matrices), 
Verbal Ability (SRA Verbal Test ^- L Scale), Numerical Ability 
(SRA Verbal Test - Q Scale), Decision Speed (same equipment ias 
Perceptual Accuracy), Response Orientation (same equipment as 
Reaction Time), and Oral Directions (Personnel Tests for In-*, 
dustry - Oral Directions Test). % . 
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(6) Achievement - Reading (Gates-McGinitie Comprehension Test) and 
Arithmetic (Level I of the Wide'Re^ge Achievement Test). 

(7) Physical Strength -.'Hand Strength (grip dynamometer), and Lift- 
ing.Ability (standing pi a tfo)\i). < > /- 



b. 



c. 




d. 



l^ouping of^Work ^iiStples - Although^ea^j^f-tist is independent, they 
at^e- grouped on th^.pfitout'accordtrt9"to,<rthe seven categories listed 
above.- ■ ., ■ • ' '^"^y- * 

Packaging of Work Sam&es - The tes:^^and apparatus are indivitjually 
packaged.. ^-Because som%c;onlponehts^re; needed for ttwo or more 
psychop^sical tasks* the^«»^pj|^st be changild for^ 
• The stsncjfifdized psycholojicJt^ests/c^ be ordered directly from 
their/rfesfpective publishers. 

■ Manual - The loose-leaf manual conjfeins most system details, in~ 
cludlngv administration instructionsi ilata entry -codes and instruc- 
>ftion's, ;kpme interpretation materpls, and^n organized, list of all 
the jobs : In the system. / 'V 



3. Work- Eval uati 



cess 



a. 



Prel imi nary ^ Scr eeni ng -|tto pre! l£i\n^y screening i^ required. In 
Tlie~Thrr&g"Tif5eT^ by. and used at " " 

Chicago Goodwill, the f|ester i| administered at the beginning of 
the program to'determine/basic abilities. 



b. 



c. 




Sequence of Work, Sample AdA'istration - The tests do not hav^ to 
be given in any. specif ic or^lV. 'f 

Client Involvement - BlBcause of the K^S^^*^ rtature of the testing 
process arid the emphasis ^j^jon accural liieasurejnent, there is 
little cJient involv^,epie^ during' ap4ia\ testingTN^^ the 
evaluator is urged tb explain the entire .'system to clients prior 
to test administration. . \ \ \ / , /; V A 

. Evaluation Setting - The psychometric fbasls^ of the Hesrter cr eaters 
a formal testing atmosphere.' The ' etjipnas 1 s o.n accurate measurement 
\ using psychophysical devices to determine reaction time, dexterity 




etc., could easily create laboratory- like environment 



ei. 



Time to Complete the Entim Systeml 4 the de veloper "estimates that 
the entire battery can>e apinisteifjed in Jboiiit five hours. Jhe 
in^jiVidually administered tfists tak^ aboutlone' hour to administer. 
The remaining fbiir hours are\devoted to telts that can be admin- 



istered to small groups. 



4. A(finini strati on 



Procedures - Currently available inform 
tails on the layout, materials n§e 
connect the electrical tijning and 
does not have to be administered 
developer states that a clerical 
easily administer the system. 
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on does not Contain de- 
each task, and how to 
ng devices; The Hester 
ained evaluator. *The . 
or evaluator aide could 



i. 



ir 



b. Method of Instnifction Giving - All instructions arp read aloud to - 
clients and many are accompanied ,b>(, short demorislraCtions. TheL' 
. manner of coijimunit'ation. of the instructions may be.,varied<td. 
accommodate* ^n^ special pi ient 4)roble!ns (e.g. ,^ hearing fff'bblems, 
Iqw intelligence). 

C Re^^jing Work *Samples^?Ininediate readministration of the .tests 
•is. nat usual ly»r^oiiimenaed because of the' possible influence of 
^ ^practice effects, if r^dmipistration ts required,: the developer - 
' suggests T6tes.t1ng- after; one or .two. weeks. " • ■ 



dv Providij^ Assistance* to *theM:ii^nt - The-evaTuator is to make ^ 
certain that .the cljerif fully understands the instructions to 
each test. No assistance is 'given during.the actual administration 
of the testsv ' . ' 

»5. Scying and i(6rms ' ^ \\ 

. a. Timing - The evaluator times the client. The timing 6f th? psycho- 
physical tests is carefully controlled by; electrical timing devices. 
' ■; ' ■ ■ 

b. Timing Interval - For many tests, timing is the speed with which 
the client responds to a specif ic« stimulus by performing highly 
' ' unique responses. A; few tests are timed from either start jto . ; 
completion or for a definite period of time. , * * • ' 

^ c. Time Norms No separate time norms, are presented.' The raw test 
scores are sent to" the.developer for computer scoring. 
, - . ■ - ... - 

* d. Error Scoring - No separate erqror scores are computed. The psycho- 
physicaT tests- use mosTtly tibe. to completion or number of 
responses performed within a dettt?ite^:,t,irae li»i.t. 

e. Scoring Aids - No scoring aids ai 

f. Quality Norms - there are no quaV 

Bnphasis on Scoring :- The emj^hasis is on, time to completion or 
number of responses performed within a definite tjie limit. ' 





6. Observation of Clients 
*a. Woif^k Performance - 

b.-Work Behaviors \J Because the Hester Evaluation System is a 

group of psychological and psychophysical 
.c. Rating System - ( tests, no behavioral obs"*ervations are made. 

d. Frequency of Observation - 

7. Reporting 

«a. 'Forms - Standardized forms are used to record responses on most of. 
the psychophysical tests. ^ All data, together with demograph^cal 
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Inf onnation , are transferred to two final fomS' 'prior to computer 
scoring by' Chicago Goodwill Industries. ^The raw scores xan be 
given to the computer in one of three ways; ^(1) by mailing the ^ 
forms, (2) by using a computer. terminal service available in larger 
citi6s> or (3) by c&llihg the results in by telephone. If the 
computer term-inal service is-^used, the printout containing the . 
results is available wi'thin 15 minutes after data entry. Mail and 
;. telephone entries are returned 'by mail . ^ * H 

b\ Final Report Form - The fol-lowing information is contained on the 
computer printout: (1) demographic amd identification supplied by 
the evaluator, (2) the scores for each' test listed utider tneir 
respective category, (3) the Data- People-Things hierarchies showing 
client level of functioning. W the feasible Worker Trait Groups 
for the client, and (5) a -selected list of job titles taken from the 
feasible Vorker Trait Groups together with their physical- 1 imitations, 
working .conditions, GED and SVP. 

a.' Vocational. Exploration - The formal testing atmosphere, and the lack 
of introductory explanations relating the tests to jobs offers the ^' 
client almost, no chaiice for vocational explbratioa^HQweyep^ _theL_.^__ 



jobs listed "on the computer pP1nf*tQut are intended to provide the 
client with information that can be used a^ a basis of vocational ^ ^ 
exploration. . 

f 

b. Vocational Recommendatio^ns - The Hester printout contains both 
general groups of jobs (i.e.. Worker Trait Groups and; specific jobsv 

< that are considered to be within the client's ability. The sys- 
tem is completely rel-ated to the DQT, even to the extent of giv- 
ing page riurtibers. f . 

■ - -' • ^ • 

c. Counselor Utilization - The system is designed to report jobs and 

job areas that are within the client's abilities. This information, 
if communicated to the referring counselor effectively, is very 
. useful . 

training in the system ^ 

a. Training Required -Yes - ' 

b. Training Available - Yes, • 

' ■ > ■ ■ ", * ' , 

c. Duration - Three days 

'd. Fotldw-up - Technical assistance is available after purchase. 
Technical Considerations 

a. Norm Base - The manual states that "norms were developed oy.er the 
years from test scores of staff members and clients at the Goodwill 
Rehabilitation Center program." However; the manual does not con- 
tain these norms. ' /■ ' 



». Reliability - Test-retest reliabilities for ^"ndividual tests on 45 
, clients retested aftfifr four weeks range from .72 to *95. These are 
high. The second type of reTiabtlity is the reproductibility of the 
job list. In a test-retest situatici^i. 78% of the job families listed 
^'on the first printout w^re the same as those listed on the second. 

c. Validity - The marjual contains a discussion of five types of valid- 
ity, but presents very little data. Tlie construct validity of the 
Hester* is based on several factor analyses; however? none of these 
ar^ given in the manual. " A" concurrent validation study of 156 deii- - 
tists demonstrated that 80% of the dentists "would have been rec- 
ommended to enter dentistry." . ' 

Reviewer's Sunmary and Comments - The Hester uses the trait-and -factor 
approach that has been used ffs a test; development model forever 40 
years. This approach has proven .successful for many psychological 
tests. The Hfester attempts to present a picture of the client's 
abilities and to match these aibjlrities with the structure of the DOT. ». 
The logical structure has a (definite appeal to persons who stress 
ability testing as part, of the vocational evaluation process. . It 
must b^e emphasized that the lack of detailed information on the • 
development' and the validity bf the system are a major source of 
. concern r The Hester does. nO-t_-dAim to. be' a • _ 

evaluation system— the developer realizes £he need for occupational 
information, interest determination, accurate behavioral observations, 
and evaluator interaction with the client. The Hesta** could be best' 
described as a very logical series of tests designed to relate client 
abilities to the Data-People- Things hierarchies of the DOT. The 
system Is probably best used for initial screening at the beginning ^ 
of the' vocational evaluation process. ^ 

Address I " - ■ ^. 

Hester Evaluation System 
' Goodwill Industries of Chicago 
120 South Ashland Boulevard • 
Chicago, Illinois 60607 ^ ' 

Cost - Total cost is approximately $4000.00. This includes hardware, 
trailing, and expendable supplies for 100 persons. 

References ' « 
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Vocational Evaluation and Wor k Adjustment Bulletin , 1975, 
6(4), -62-65. r~ 

• *Hester, E. J..'The differential effects of disability and sex on 
job^ sample task performance. Unpublished doctoral disser- 
tation, Loyola University, 1969.- < * 
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Hester, E. Jt, Hester Evaluation System. Unpublished paper. Good- 
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Mitro-TOWER 

1. Develojjment 

a. Sponsor - ICD Rehabilitation and Research Center *; ' - 

• - ■ ^ 

b. TargiBt Group - The system is primarily aimed, at a general rehabilita- 
tion population, but it can also be used with special education stu- 
dents, the disadvantaged, and. adult offenders. Although not specially 
designed for mentally retarded persons i it can also be used with edu- 
cable mentally retarded persons. . ' , 

c Basis of th6' System - The system is basically a group aptitude test 
that uses work .sample techni.ques to measure seven aptitudes .as defined 
and used in the Dictionary of Occupational Titles (DOT). ' The results 
are related to the aptitude requirements for entry level jobs in 
specific Worker Trait Groups. * - 

^. Organization . , ' ." 

^ a. Name and Niinber of Work Samples - The system contains 13 work samples,, 
divided into five groups of what can be called general aptHudei. : ^ 
J_ J^9^T of the. wor k .-samples . (Wan t_ Ads Comprehen Coding,. Blue-__ , 

' " /print" ReadTngi^ a Payroll Computation) have alternate forms to pre- 
vent- copying during administration and for possible use during retest- 
ing. The primary aptitude(s) -and their DOT abbreviatior\\f or each work 
sample are given inthe parentheses: 

1. Motor - Electronic Connector Asstely CF-fi-nger dexterity); Bottle 
Capping and Packinq (M-manual dexterity); and Lamp Assembly, (K- 

motor coordination). " • 

' . -■ ' 

2. Spatial - Blueprint Reading (S-spatial reasoning); and Graphics 
Illustration (S-spatial reasoning; K-mo tor coordination) . 

3. Cleri-cal Perception - Filing^(D-,clerical perception; K-motor coor- 
dination); Mail Sorting (Q^3pa|f:al ' perception; M-mahual dexter- 
ity); Zip Coding (Q-clericfT>^|Jrc^|ftion); and Record Checking 
(Q-clerical perception). >' ■ • . 

4-. Numerical - Making Change (N- numerical reasoning); and Payroll 
. Computation -{N-numerical reasoning). , ' * 

Verbal - Want Ads Comprehension (V-verbal comprehension); and 
Message Taking (V-verbal comprehension). , . 

b. Grouping of Wor^k Samples - The work samples are' grouped according to 
the five aptitude areas listed .above. , 



c. Packaging of Work Samples -'All work samples are individually packaged. 
Because the system is designed for group administration, a separate set 
of work samples is needed for each client, plus a demonstration set for 
the evaluator. » . • 

d. Manual.- The system contains several manuals. A general administraf-, 
. tibn and scoring manual, a manual for the group discussion program, 
* a separate manual for each work sample, a technical manual, and an 
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inventory manual. All manuals are well -organized and contain complete 
and detailed instructions on setup*. administration, scoring, use of re 
suits » etc. All manuals are printed. m 



the administration of Micro-TOWER. The manual states, however, that 
a period of general orientation to the system should be given prior 



b. Sequence of Work 5ample Administration - The manual contains several^ * 
suggested schedules for administration of the work samples and for 
group discussion. These schedules are only suggestions andithe work 
samples do not have, to be given in any set sequence. WithiQ each work 
sample a carefully defined sequence, is followed. All ins^^ructions to ^ 
the, clients are recorded on a cassette tape. The first stfep is th6 / 
presentation of a series of qccupational phtitos which illustrate jobs 

. requiring the skills assessed by the work sample. Each work sample ^ 
provides an untimed learning/practice p^rio'd which includes taped in- 
structions, visual illustrations, evaluator demonstrations, andean 
opportunity for clients to practice. During this, period, the cassette 
.tape automatically stops at preselected -pi aces- so tha^t the evaluator 
Can give .additional instructions^ etp. The evaluator is also free to 
stop the tape at any time If additicwial help is needed. After this ^ 
learnjng/practice period comes the evaluation period. Here cTients - 
work entirely on their own without any helft. The purpose in clearly 
separating the practice and evaluation periods is to m^ke certain that 
the cl ient , has learned, the task before being .required to perform it. 
The system 'places a great deal of emphasis on separation bf learning 
from performance. After completion of the task, the clients fill out 
a self-report form ratijig their, interest and perceived ability. 

c. Client Involvement - Micro-TOWEfbempliasizes client -involvement. This 
, 'is accomplished in several ways. Prior to administration of the work 

sample, occupational information is provided; during the instruction 
period, the evaluator stops at several points to answer questions and 
provide additional instructions. The practice period also permits ' 
feedbaK:k. The greatest client involvement is during the. group dis- 
cussion program. Here, client values, interests, needs, etc., afre 
discussed. Suggested activities are provided in a separate manual. 
Clients also receive formal .feedback of their performance on the- work 
■ samples. . 



d. Evaluation Setting - The evaluation setting could b%st be described 
as a combination of a formal testing situation and a group counsel- 
ing environment. « 



e. Time to Complete the Entire System - Total testing time is about 15 
hours; if group discuasi'ons are included* the total evaluation takes 
from 19 to 20 hours.' Depending oji what schedule is used, the battery 
can^ be administered in between three and five days, the ma/ifial con-. 
tains several suggested schedules which vary in the number of hours 
per day that the work samples are administered and in the presence 
and duration of the group discussion periods. ^ 




to work sample a^dministration. 




ERIC 



4. A<feft1n1stration 

• ■ * • . ■ ■ ■ * 

a. ' Procedures r General administration procedures are described in* the 

. overall manual. The specif ic manual on .each work sample contains de- 
tailed instructionston materials, layout, administration, scoring cri- 
• . teria, etc. All procedures are thbroughly defined. ' 

b. Method of Instruction Giving - ^Instructions are given by several meth- 
. ods. Each work sample begins with a series of large photographs sho'w- 

: ing jobs requiring skills related to the worki sample. The major in- 
structional njethod, however,' is a separate audio-cassette tape for 
each work sample which is coordinated with the evalua tore's demonstra- 
tions. This tape is programmed to stop at certain critical points so 
that the evaluator can provide help, give additional explanations, or 
check the results of the practice exercises. The system emphasizes 
. standardized instruci:ions and timing; it uses the audid-tape as the 
major means of insuring standardization. No written i/istructional 
materials are used. However, to complete some of the verbal and 
clerical tasks, a third to fourth grade reading level requiihed. 

c. Repeating Work Samples - The man ual contains, no 3nstructiQn|.-ar-quide=- 
' lines for repeating work samples. The only reference to readministra- 

tion is made: in regard to the use of alternate forms for four work 
samples, ... ' ' * 

d. Providing Assistance to the* Client - Extensive assistance is provided 
• during the learning/practice period. NQ,ne is given during .the actual 

Evaluation period; 

5. ■ Scoring and Norms . 

: 1 ■ .i . • " ■ . ■. 

a. Timing - The evaluation period on each work sample is tini^d through 
,]fehe use of the cassette tape. The^i tape tells the clients to "begin," 
then runs through a number of minutes of blank tape and then tells 
the clients to top." This^ procedure is to insure accurate timing. 

b. Timing Interval - Timing is for a. specified period within each work 
sample. . , 

c. Time Norms - No time norms are used in this system. The score for 
each work sample i^the number of correct responses; report forms 
also provide space for recording the number attempted. ♦ • 

, d. Error Scoring - A separate form is used fpr each work sample to score 
the number of correct responses, pieces completed, etc. The entire 
product is scored for each work s^ample; there are no random checks. 
The raw scores for each work sample are recorded on the ^'Summary of 
Work Sample Performance" sheet. Quality standards are carefully de- 
fined. . 

' e. Scoring Aids - Some use is made of scoring aids. 

f. Quality Norms - The raw scores for each work sample are compared to 
the desired norm group. A scale is used to convert the scores into 
one of five possible ratings. These ratings are based on percentile 

> , • 
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norms, one rating for each 20 percentile points. Thus, a very high 
rat;.ing means that the client scored above the 81st percentile. Norms ^ 
are available for 19 different groups. ' • , ' > 

g. Bnphasis in Scoring - The emphasis- is on the quality of work prdcluced> 
within a specif ied* time period. , • 

■ . . * . • • . 

Observation of Clients i ^ ' ' 

a. Work Performance - No specific work performa^nce factors are defined in 
the^manual or llisted on tJhe "Behavioral Observations" form; Fpr each- 
work sampl e there i s. a space for the evaluator to re<j:ord general com- 
ments; t;here are ho suggestions in the manual as to what these should . 
cover^ . ' . 

■ i: . ■ . ' , . ■ ■ . 

b. . Wdrk Behaviors - Five Work behaviors are listed on the "Behavior Ob- 

servations" form. These are not defined in behavioral terms (e.g., 
attention span .and efficiency). This form also includes a category; 
called "General Behavior'- which includes it^s such as apfaearance, 
self-image, and reactiOTi to pressure. , The evaluator is to make ^hort 
notf»s for aljl ^f-the '^h^hf^v^^rg" listed on this form. 

c. Rating System - No rating system is used for any of the items on the 
"Behavioral Observations "^form. However, a six-point scale. is used' 
for general and work behaviors on the Summary Report -Form. 

d. Frequency of . Observation -. Observations are to be made during the . 
training. phase, during the- performance. of the work s^ample,.. and dur- 

> ing group discussion. While no 'schedule for frequency is specified, 
it would a'ppear that frequent observations are expected. 

■ ■ ■ I • - . 

Reporting V 

a. Forms The Micro-TOWER uses a variety^ of forms. ' This includes a raw 
score form for each work sample, the "Behavioral Observations" form 

. ^ mentioned above, ra "Summary of .Work Sample Performance" form, an 
' attendance fonn, as well as reporting forms. The -client completes, a 
"Client Interest and Perceived Performance" form after the completion' 
of each wori< sample; there is ^Iso a summary sheet for this form. 

b. • Final Report Format - There are three forms used for reporting. The- 

first is a profile sheet based on percentiles that gives the client's 
results on each work sample on a scale from much below average to 
much above average. The second is a narrative summary report format 
which may or may not include the forms mentioned under 7. a. Finally, , 
there is a "Recommendations^" form which uses a checklist format to 
cover topics such as special training, individual attention, and 
vocational recommendations. - . 

Utility 

■■ — ■ « « • 

a. Vocaitional Exploration -<The information given at the beginning of 
each work sample is designed to make clients -aware of what jjobs are • 
related to the aptitude(s) being measured by the work sample This 
information, plus the group discussion, provide the client with some 
occupational information. - • * 



b.^ Vocational' Recomnlendat ions - The systerg relates aptitudes to Worker 
Trait 6roups that require aptitude patterns similar to those of the 
client. ThuSi in making recoramendations, the evaluator would match 
clients' aptitudes with those required by the Worker Trait Groups. 
This- |)rocess would be further broken down according to* interests, 
interpretations from behavior observations, and. the resuUs of group 
discussions. These recofimendations would be written in narrative form 
in the narrative sumnary report. \ 

■ ■ ■ • . ./ 

c;, Counselor Utilization - The system can be used to (1) produce a final 
repdrt that is designed, for the referral agency, or (2) as the first 
step in an extended ev^iluation. ^ . 

Tra j ni ng 1 n t\e ^s tem 



raining in tl« 
. Training Re 



a. Training Required - Although formal training is not required, it is 

strongly recommended. 

. . . . . . \-. . . . ^ 

,b.- Training Available - Optional training prog raips are avatlable. 

c. Duration — Two or t^w^e-day s d epend ingn^n-the train4ng-optienv— 

d. Follow-up^-^Jhis rinformation is not specified. 
Technical Considerations . \ 

a. Norm Base 7 Norms are availably on many groupsT a national sample of 
1,500 rehabilitation clienj^, males, femalesji Spanish-speaking, left 
handed persons, physicallj^'d gabled, psychiatrically disturbed, brain 
damaged, cerebral palsied, students in sjjeclaT education, the disad- 
.vantaged,' ex-drug abusers, ex^alcohoUcs,. and adult offenders. Ir> , 
addition, help is available from ICD to assist\faciTities in develop- 
ing local norms. * \ 

b. Reliability - The Technical Manual provides data\on the reliability of 
the Micrp-TOWER work samples* The coefficients, i'ange from .)4 to .97. 
The d^ta was based on test-retest, alternate fonrts, and internal con- 
si s.tency estimates. 1 

c. Validity - Although a factor analysis revealed a l^rge general faetorv, 
% ^ there was also evidence for grouping the work "samples .into the five 

*' aptitude areas. <The construct validity of the work\sample battery is 
supported by examination of the intercorrelations of\ the Micro -TOWER 
work safhples.. Correlations are also availably with me factors from 
the General Ap'titude Test Battery (GATB). 'All data are reported-4i) 
the Technical Manueil. One study providing positive evidence of Micro- 
TOWER's use in decision-making compared the reconinendations made after 
a one week evaluation with Micro-TOWER to th^ reconinendations made af- 
ter four additional weeks in TOWER. There waVa 74?^ agreement on voca- 
tional recommendations, suggesting that decisions can be reached in 
a much shorter time for many individuals. 



,11. Reviewer's Summary and Comments -"Micro -TOWER may best be described as a 
' • group aptitude battery that uses work sampling techniques as the assess- 
ment method. The system claims to'%easure seven of . the nine aptitudes, 
that are used in 4:he Worker Trait Groups arrangement of the DOT. The 
systan has 'the advantage of being group administered in a fairly short 
period of time, thus making maximum use of evaluator time. The system 
< attempts to go beyorid the m^e assessment of aptitudes by providing occu- 
pational 'information and grpup discussion. Adequate norms are available, 
' except for employed workers". The system generally takes a standardized, 
psychological test approach with emphasis on carefully controlled adminis- 
tration conditions, the separation of learning fron)' performance, and the 
reporting of results in tertns of ^percentiles. • On^major problem with the 
system is the lack of thorough behavioral observational materials. Anpth- 
er possible problem is the conveV'se of the advantages of a* group adminis- 
tered test - the evaluator may not be '(^ble to provide the client wfth thg 
one-to-one relationship that is needed for some; severely disabled persorw. 

12 . Address - Micro-TOWER 

ICD Rehabilitation and Research Center 

340 East 24th^ Street 

- - New-Yor1c,;r!ev( York 10010 . . 

13. Cost - The cost of the mcro-TOWER depends' primarily upon the number of 



cTTents being tested in^the group. Each client requires a .complete set 
^ of equipment. An additional set of equipment is needed for the evaluator. 
Prices are afvailable for group sizes from 4 to 30, for example: 

Number of Persons Tested Per Group Price 

• 4 " $ 4.753.00 

7 . . ■ $ 6,015.00 

10 $ 7,207.00 

20 SlOaTO.OO . 

: . ,30 ' $12,647.00 

T|ie above 'prices include all equipment, forms to test 100 clients per work 
sample, one set of evaluator's equipment for each work sample, a cassette 
playback and a cue-stop system, table easels and photo books, all shipping 
and insurance charges, and training in the use of the system. ^ 
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. Vocational Infonnation and Evaluation Work Samples 

(VIEWS) ^ • ' 

1 . Development . ' • . 

a. Sponsor - Philadelpliia Jewi^ Employment and Vocational Service 

J b. Target Group - The system ts especially designed for mild, moderate 
and severe mentally retarded persons, ■ . ^ 

■ ■ . ■ 

c. Basis of the System The VIEWS is based on four Areas of Work an4 
s4x Worker Trait Groups (WT6) in the Dictionary of QccupationaJ ' 
Titles (DOT). , ^ 

2. Organization ^ , 

. a. Name and .Number of Work Samples - The 16 work samples are organized 
according to the DOT, 

• 1. Eletriental Area of Work - ilan^^ — ^ 
Bolts and Washers Sorting; Paper Count and Paper Cutting; ^ 
Collating and Stapling; Stamping; Nuts, Bolts and Washers 
Assembly; and Screen Assapbly. Feeding-Offbearing /NTG: 
^ Machine Feeding. , * ' 

2. Clerical Area of Work Routine Checking and Recording WTG: 
Mai] Sort and Mail Count. Sorting, Inspecting, Measuring and 
Related WTG: Nut Weighing; and Valve Disassembly. , 

3. Machine Area of Work - .Tending WTG: /Drill Press 

4. Crafts Area of Work - .Manipulating WTG; Budg'ette Assembly; 
' Valve Asseroblyj and Circuit Board Assembly. ^, 

"b. Grouping of Work Samples - The work samples are grouped according 
to the four areas listed above. 

c. Packaging of Work Samples - Fourteen wsflc- sampl es are individually 
packaged in portable plastic cabinets, ^he Drill Press and Machine 
Feeding Work Samples are permanently mounted on a sturdy work table. 

J d. Manual - An offset manual contains all administrative details, such 
as setup, evaluator and^client instructions, and scoring pro6edures. . 

3. Wor k^val uation^ Process " 

a. Preliminary Screening - No preliminary screening is required. 

■ ' ■ • < 

b^ Sequence of Work' Sample Administratidn - The work samples are given 
^ from least-complex, to most complex. .Each work sample has three phases: 
(1) Dwonstration - the evaluator follows the manual to provide an oral 
description and a physical demonstration for the client; (2) Training - 
the client is trained to a predetermined criterion of mastery on each 
' work sample -r-^uring this phase the. evaluator is free to use a wide 

variety of * techniques to make certain that the client learns the 
t^sk; and (3) Production - after the criterion have been achieved, 

• ^ ' ••• ' -.32 ■ ' 



* the client is assigned a set number of cycles of the work sample to . 
•perform independently. The purpose in separatinj^^the training and 
■ production phases is to make sure that the c^^ept has learned each_ 
task .before he perfomis it. ^ 

c. Client Involvement - There is extensive client involvement. In the 
training phase for each work sample, the evaluator and the client 
has. a significant amount of interaction during the learning process. 
The Evaluettor's Handbook calls for an informal client f eed backus es- 
sion after- the first day as well as on subsequent days when needed. 
There is little client involvement tbring the production phase. 

d. Evaluation Setting - A realistic work atmosphere and setting are 
sty*essed in the Handbook and during, eval pa tor training. 

♦ , 

e. Time to Complete the Entire System - The developer estimates that 
the VIEWS can be given in from four to seven, five-hour days; i.e., 
ZO to 35 hours. ' ' / 

* ■ . ■ ■ 

Administration ' 

a. Procedures - The Handbook contains all details necessary for admin- 
.. istration. A photograph of each work sample is used to insure proper 
layout. The instructions for the demonstration phase are given in 
detail and include both oral and p/jiysical directions. The training 
ph^se criterion are clearly given, v, ' . 

b! Method of Ins tructiw Giving - No* reding is required for any work sam- 
ple. The demonstration Jjhase uses pr^l instructions plus modeling. 
During the training phase the evaluatoi? is free to use a variety^ 
of verbal and nonverbal techniques; flexibility is stressed here. 
Because each work sample is individually administered, t.he clien^ 
can receive instructions using the methods which best nieet hi^ , 
needs. , / - 

c. Repeating Work Samples' - The VIEWS does not place much empj^asis on 
repeating work samples; it is designed so that the clien^ihould" 
have learned the task before the performance phase. Hpwever, 
work samples may be repeated if considered necessary by the 
evaluator. * . 

d. Providing Assistance to'the Client - Extensive assistance is pro- 
vided during the training phase; little is given during the production 
phase. If help is needed during the production phases, the evaluator 

-. ' is to record this on the appropriate behavior observation form. 

Scoring and Norms ' 

a. Timing - The evaluator uses a time stamp iriachine to time the client. 

b. Timing Interval - Timing on each work' sample bfcgins when the client 
enters the production phase and ends with the completion of the task. - 

c. Time Norms - Raw time scores are converted to a three' point rating 
scale. Predetermined time standards using the MODAPTS approach aVe 

' also available. . 



d. Error Scoring - Each worlj. sample is checked against carefully defined 
quality standards. . ' ' » .. 

e. Scoring Aids - Some use is made of scoring aids. * 

f. Quality Norms - The total number of errors for each work sample are . 
J converted to a three point rating scale. Thte system also contains 

rate-jDf-fearning norms for use during the training phase. 

g. Emphasis in Scoring - Time and quality are both given equal weight 
In .the VIEWS. 

Observation of CI ients 

a'.» -Work Performance - Ten work factors (e.g., motor coordination, finger 
dexterity, and work rhythm) are carefully specified (e.g.. Finger 
Dexterity - turning nuts; handling small pieces). Each work sample 
X has several factors, listed that are to be observed. • 

b. . Work Behaviors - Work behaviors such as attendance and' punctuality, 

response to training, and communication are clearly defined and ob- 
served during the course of the day. 

c. Rating System - No rating system is used for work behaviors and per- 
formance factors. 

d. Frequency of Observation-- Th'e VIEWS uses extenslveobservations. 
Observation of defined work factprs is reqinicjsd-^foi^ach i^^^ 
sampl e . Wor k behav i or o bs er vatioDS-aremiaae da 1 1 y . However , no 
established time-or sampla-prScedures are used for the work be- 
haviors. * ■ . _ 

Reporting 

a. Forms - The system uses three standardized forms: (1) a client re- . 
cord fortn for recording work sample behavioral observations, scores, 
and work performance (there is a separate page of this form for each 
work sample); (2) a daily observation form for siMnari zing ^ork be- 
haviors and performance; and (3) a final report form. 

b. Final Repor^t Format - The VIEWS final report uses a' standardized 
format to present information on the following: general observations, 
interpersonal relations, training, worker characteristics,, recommen- 
dations, and a" profile sheet containing work sample results including 
the industrial time standards for the work samples. Recommendations 
are given for training techniques. Worker Trait Groups, and for other 
services that may be required. 

Utility 

» • • 

a. Vocational Exploration - Because some of the tasks are not actual jobs 
because almost no occupational information is provided, the VIEWS is 
of Tittle use in occupational exploration. # 



b. A^pcational Recomnendations - Specific recommendations are made; 
je are related to the six Worker Trait Groups covered by the 

IS. • ^; ' ; - 

c. ' Couikelor Utilization r- The system *and 4he , final repor't are oriented 
toward the counselor. 



i 

\\ 

A. 



9. Training Required 

a. . Training Required - Yes 

b. Training Available - Yes 

c. Duration - One week in Philadelphia for^new users. A two day on-site 
trannirig is required for facilities that already have the JEVS Work 

. ' • Sample Battery. i_ ^ ' : 

d. Follow-up - One on-site visit for those who come to Philadelphia for 
VIEWS triaining. . ' 



I 

10. Technical Considerations 



a. 

b. 
c. 



Norm Base - The VIEWS was norwed on 104 mentally retarded persons 
between the ages of 16 and 61 with a median IQ of 50. MODAPT pre- 
deternilne^ time s'tandard norms are also availal^le. 

Rellablldiy - No data presently available. 

Validity 4 No data presently available. 



11. Reviewer's Sunroary and Comments 

■ " ■ il ,1 ■ ■ 

The VIEWS jjattempts to evaluate the vocational potential of mentally 
retarded adults for jobs in six Worker Trait Groups. Job areas that are 
very coninon in'khe national economy and, more^' important, job areas where 
many retarded persons have found successful apployment. The most unique 
feature of the ^ystem is the attempt to separate learning from perform- 
ance. Here the developers believe that the cl'lent- should first be thor- 
oughly taught the task prior to performing it under iimed conditions. The 
VIEWS also usesf standardized" behavior observations wffch are combined with* 
time and quality scores to produce a wel 1 org^rized f|n|l report* The 
major problem with using tJ^ ylEWS by itself |s, the A^k of occupational 
information. | • \ <■ . *' 

12. Address ' 

i ■ 

Vocational Research Institute ; 
Jewish Employment and Vocational .Servic^ ' 
1624 Locust Street , 
Philadelphia, Pennsylvania " 19103 ' l i 

■ r 
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13. Cost 



■ Work Sample (hardware, manuals ahd forms) 

(including shipping) , • 
Tuition for one week training 
One on-site training visit 

(plus travel expenses) 



$4,895.00 

350.00 
630.00 

$5,875.00 
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